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Understanding Game Theory via Wireless 

Power Control 

Giacomo Bacci, Luca Sanguinetti, and Marco Luise 


In this lecture note, we introduce the basic concepts of game theory (GT), a branch of mathematics tra¬ 
ditionally studied and applied in the areas of economics, political science, and biology, which has emerged 
in the last fifteen years as an effective framework for communications, networking, and signal processing 
(SP). The real catalyzer has been the blooming of all issues related to distributed networks, in which the 
nodes can be modeled as players in a game competing for system resources. Some relevant notions of GT 
are introduced by elaborating on a simple application in the context of wireless communications, notably 
the power control in an interference channel (IC) with two transmitters and two receivers. 

Relevance 

Recently, the mathematical tools of GT [1] have attracted a significant interest by the wireless com¬ 
munications and SP engineering communities [2, Part II], due to the need for designing autonomous, 
distributed, and flexible systems, in which the available resources are allocated through low-complexity 
and scalable procedures. Games are appealing, owing to some characteristics that are not common in 
classical optimization: as an example, GT can handle interactive situations in which each player can only 
have a partial control over the optimization variables, while using its own performance metric. It is true 
that commonalities can be found with other disciplines, such as multi-objective optimization [3], convex 
optimization [4], and learning theory [5], but GT possesses many distinguishing features that make it 
essential for the standard current toolbox of communication as well as SP engineers. 
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Prerequisites 

The readers require basic knowledge in linear algebra and wireless communication theory. 

What is a game? 

To take advantage of GT and its associated theoretical tools, the first step is to model the problem at hand 
as a game. In doing so, three ingredients must be identified: 

• the players, that represent the main actors in the problem, having conflicting interests and affecting the 
performance of everyone else in the game; 

• a set of strategies available to each player, that determines what each player can do; 

• a utility function for each player, that measures its degree of satisfaction as a function of the combina¬ 
tion of all player’s choices. 

This description may encompass a large number of situations: to mention a few examples, players in a game 
can be base stations (BSs) allocating the resources in a cellular network to increase the system throughput, 
or watermarking devices choosing algorithms to face potential attackers. 

The objective of the modeling effort is to describe the game using its strategic-form representation: a 
triplet (/C, {Sk}kelc-> {^k}keK)^ where: /C = {!,••• is the set of players, where K is the number 
of players; Sk is the set of strategies for each player A;; and Uk{s) is the utility function (also known as 
reward or payoff') associated to player k for a combination of choices s = [si,..., sk] = s\^], where 

^\k = [<51,, Sk-i^ Sk+i ^..., Sk] denotes the strategies taken by all other players except player k (the 
opponents). 

In general, the game outcome Uk{^) for player k depends on all players’ choices through s, that stems 
out from the interaction of the players with possibly conflicting interests. This brings forth a couple of 
distinguishing features of GT: 

• each player k can have a different performance metric; this feature is captured by a per-player specific 
function Uk{s), that accounts for the player’s nature; 

• each player k has partial control (sk G Sk only) over the optimization variables. 

The first property is strictly tied with multi-objective optimization [3], although a clear difference exists 
in the scope of the optimization variables, as in multi-objective optimization we have full control over 
the variables. The second property is tightly related to the framework of distributed optimization [4], with 
which it shares many intersections, although there are specific differences: one of the most important is 
that, while in distributed optimization the agents follow some common given rules, in GT the players act as 
independent decision-makers. 
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(a) Topology of the network. (b) Payoff matrix. 

Fig. 1: Representation of the NFE game. 


The near-far effect (NFE) game 

To picture out the meaning of the strategic-form representation, let us consider an example taken from a 
very common wireless communications scenario: the IC, represented in Eig. la, in which the two transmit¬ 
ters interfere with each other in the attempt to reach their own receiver. This simple scheme encompasses 
many scenarios: it can be used to model i) a multicellular system, with red and blue nodes belonging to 
two different cells; ii) a heterogeneous network, where the red and blue nodes belong to a macro cell and 
a small cell, resp.; Hi) a cognitive radio system, where the red and blue nodes are primary users (PUs) and 
secondary users (SUs), resp.; and iv) a device-to-device system, where the receivers are also network nodes. 

Using GT, we can i) model the problem at hand in a suitable manner, and ii) provide the theoretical tools 
to solve it. In this case, solving means devising the optimal transmission strategy to be selected by the two 
wireless terminals of Eig. la. In particular, we assume that the two nodes are allowed either to transmit at 
a certain power level p, or to stay idle. This situation can be modeled as a game, with K = 2 players, and 
strategy sets Sk = {0,p} for A: G /C = {1, 2}. Eor simplicity, we also assume that the two terminals choose 
their strategies simultaneously (i.e., without being informed of the other’s choice) once and for all (i.e., they 
cannot make any change after observing the outcome of the game) - in GT parlance, we consider a static 
game. Einally, since players and strategy sets are both countable, the game is finite. 

As depicted in Eig. la, player 1 (the far terminal) is located much farther away from both receivers than 
player 2 (the near terminal). To describe this situation in a mathematical fashion, we introduce the power 
gains hjk G experienced by terminal fc’s signal when propagating to receiver j. Eor simplicity, let us 
assume hjk = hk ior j = 1^2 with /ii//i 2 1 (we will better quantify this ratio later on), thereby giving 

rise to the so-called near-far problem. 

We need now to define a utility function, and to do so we consider that each terminal achieves a degree 
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of satisfaction that depends both on the success of its transmission and on the energy spent to transmit at 
power Sk. Mathematically, this translates here into a (dimensionless) utility Uk{s) = tk{s) — Ck(s), where 
tk(s) accounts for the outcome of the transmission, and Ck(s) measures the cost associated to using 
We assume that the cost scales linearly with the transmit power, and that it is independent of the other 
terminal’s strategy: Ck(s) = cs^jp. Measuring tk{s) is more complicated, as it has to capture the interaction 
between the players as a function of the selected strategies si and 52 . In practice, successful reception of a 
signal in a multiple-access scenario (such as the one considered here), be it in the time, frequency, space, 
or code domain, depends on the signal-to-interference-plus-noise ratio (SINR) which measures the ratio 
of the useful received signal power to the amount of undesired power collected at the receiver. Under the 
assumption of additive white Gaussian noise (AWGN) with power cr^, we get 


7fc(s) = 2 ^ fJ-k{s\k)sk > 0, 


( 1 ) 


cr- + h\kS\k 

where \A; = 2 if A; = 1, \A: = 1 if A: = 2, and F > 1 is the processing gain, that depends on the multiple 
access technology and on the receiver processing. For the time being, let us assume the transmission to be 
successful if and only if > 7req, where the minimum SINR 7req depends on some system parameters. 
So, when < 7req. the transmitted message cannot be decoded at receiver A;, and tk{s) = 0. On the 
contrary, when > 7req. receiver k can correctly receive the information associated to user k's signal, and 
tk{s) = A, where A is a dimensionless parameter that accounts for the throughput achieved at destination. 
To properly capture the cost-benefit analysis that regulates any practical wireless system, it makes sense to 
assume t ^ c. 

A profitable way to investigate finite static games in their strategic form, such as our NFE game, is 
through the so-called payoff matrix (Fig. lb) in which player I’s strategies are identified by the rows, player 
2’s strategies by the columns, and the entries of the matrix (the pair of numbers in the box) represent the 
utilities {ui (s) ^U 2 (s)) achieved by the players. Under the assumptions that p = ^^ 7 reqand ^ 

(see [6] for further details), it is easy to fill out each box of the matrix based on the hypotheses listed above. 

Once the game is in its strategic form, we have to solve it, i.e., to predict its outcome. In the NFE 
game, we assume that both players: /) are rational; ii) control their own strategies only; and in) know 
each other’s payoff. The first assumption means that each player is a utility-maximizer decision maker. The 
second hypothesis casts this problem as a noncooperative game, in which the players compete to unilaterally 
maximize Uk{^). Einally, the third hypothesis involves the concept of complete information that each player 
has about the game. By inspecting the payoff matrix in Eig. lb, it is apparent that player 2’s best strategy 
is represented by s 2 = p whatever si is, since t — c > 0 under the assumption t c. Eor this reason, the 
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Fig. 2: Payoff matrix of the IC game. 


strategy S 2 = 0 is said to be strictly dominated by 52 = p, as 1 ^ 2 ([^i, 0]) < U 2 {[si^p]) \/si G Si. This is 
known to player 1 as well, that rationally chooses to play = 0. As a conclusion, the predictable outcome 
of the NFE game is = [ 5 ^, 52 ] = [0,p], as highlighted by the shaded box in Fig. lb. In GT parlance, this 
game has been solved by applying the iterated elimination of dominated strategies, or iterated dominance 
for short [1, Ch. 1]. 


The IC GAME 

Let us now slightly modify the scenario represented in Fig. la. Assume for example to move player 1 
closer to its receiver, such that the distance between player 1 and both receivers becomes the same as the 
distance between player 2 and both receivers. For simplicity, let us also suppose hjk = /i for j, fc = 1,2. By 
using p = ^7req. following the same considerations taken for the NFE game, it is easy to obtain the payoff 
matrix reported in Eig. 2. As an exercise, we can verify that no strictly dominated strategies exist, and thus 
we cannot apply the iterated dominance procedure used to solve the NEE game. 

To get out of this impasse, we introduce the concept of best response (BR) bk{s\k)^ which is mathemati¬ 
cally defined as: 

h (s\fc) = arg max Uk {[sk,s\k]), (2) 

i.e., the best that we can get out of the game once we know the opponents’ moves Since player 1 
chooses rows, we can compute its BR by examining the columns that can be possibly selected by player 2. 
When 52 = 0, 61(52 = 0) = p. Conversely, when 52 = p, 61(52 = p) = 0. The same can be obtained for 
player 2, and we end up with the players’ BRs, underlining the relevant payoffs in Eig. 2. We find two boxes 
(shaded background) containing the BRs of both players, representing two stable states, where “stable” here 
means that such states are attained by some multiple agents with conflicting interests that compete through 
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self-optimization, and eventually reach a point where none of them has any incentive to unilaterally deviate 
from. 

A point that possesses such properties is termed a Nash equilibrium (NE) of the game, defined as a 
strategy profile = [ 5 ^, such that, for all A; G /C, 

or, equivalently, 5 ^ G As an exercise, check that s'*" = [0,p] is the unique NE of the NEE game. 

The notion of NE encompasses many interpretations of GT, not discussed here for brevity, that the 
interested readers can find in many textbooks (e.g., [7, Ch. 1]). Modeling the players as self-optimizing 
decision-makers finds a suitable application especially in the context of SP, in which the devices can be 
programmed to do so. Since each player has only a partial control of the game, the concept of NE is tightly 
coupled with the application of distributed algorithms and machine learning techniques [7, Part II]. 

Eor brevity, we will not discuss here theorems on equilibrium existence [1, Ch. 1], that establish the 
existence of the NE in particular classes of games, and on equilibrium uniqueness [2, Ch. 3]. When unique¬ 
ness cannot be ensured, like in the case of the IC game, we face the problem of equilibrium selection. One 
solution to this issue is the concept of correlated equilibrium (CE) [1, Ch. 2], a generalization of the NE, 
where an arbitrator helps the players to correlate their strategies, so as to favor a decision process in the 
interplay - e.g., letting them adopt = [p, 0]. 

Introducing continuous powers 

The solutions of NEE and IC games, in which at most one terminal can successfully transmit, directly 
stem out of choosing a binary strategy set Sk = {0,p} for both players. Let us see what happens if any 
power level in the continuous interval [0,p] can be selected. This amounts to setting Sk = {sk C M : 
0 ^ Sk < p}. Within this setting, the power control problem can be studied as a continuous game [7, 
Ch. 2]. In our attempt of getting closer to a realistic scenario, let us also modify the utilities to better model 
how real data networks work in practice. A good approximation for the effective throughput in a packet- 
oriented transmission is tk{^) — t{l — exp{— 7 ;j^(s)})^ [8], whose behavior is depicted (red line, left axis) 
in Eig. 3. In our expression, L denotes the number of information bits per packet (here, L — 20), and t is the 
communication rate (in b/s). To properly capture the tradeoff between obtaining a satisfactory throughput 
and saving transmit power - similarly to what considered for the NEE and IC games -, we will adopt a 
“green” approach, based on improving each player’s energy efficiency [8]. This can be done by defining 
player /c’s utility as the ratio between throughput and power expenditure, thus accounting for the number of 
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Fig. 3: Throughput (red) and utility (blue) as functions of the SINR (continuous NFE game). 


bits correctly delivered per joule of energy consumed: 

Uk{s) =tk{s)/sk [b/J], (4) 

whose normalized behavior is reported (blue line, right axis) in Fig. 3, with /i/^(s\^) defined as in (1). 

Using straightforward manipulation, player fc’s BR (2) turns out to be bk{s\k) — 
where 7^ is the “optimal” SINR such that [ 8 ]. For instance, 

when L = 20, we get 7 ^ ^ 4.5 = 6.5 dB for A: = 1,2 (see Fig. 3). Based on such BR, the continuous IC 
game presents a unique NE, represented by the fixed point s'^ = for /c = 1,2 [ 8 ]. 

How can the NE be “visualized”? Let us consider a particular realization of the network sketched in 
Eig. la, with the following parameters:^ hu = 0.75, /i 2 i = 0.25, hu = 0.5, /i 22 = 1; F = 4; = 5; 

and L = 20. The solution of this game is given by the NE = [2.99,1.97], yielding normalized utilities 
^?ii(s^) = 0.269 and ^U 2 {s'^) = 0.407. We display in Eig. 4 the (normalized) utilities at the NE (green 
diamond) on the bidimensional normalized utility plane, given by all achievable utility pairs (1/1 (s), 1/2(s)) 
(shaded region), for any strategy profile s E 5 i x ^2 (the utility plan can be found via a numerical search 
using [9]). Note that and 1^1 (s^) < 1^2 this is due to the better channel conditions experienced 

by player 2 (both in the direct and the interference links), that make it achieve the optimal SINR 72 with 
a lower power consumption than player 1. However, unlike the finite version of the NEE game, where 
= 0 (and thus fi(s^) = 0 ), now player 1 can successfully connect to its receiver, getting a throughput 

^The Matlab code for all examples presented in this note is available for download in [9]. 
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Fig. 4: Normalized utility plan (continuous-power NFE game). 


ti(s^) ^ 0.8t (the same as ^ 2 ( 3 ^)), at the cost of a slightly higher power consumption ( 5^/52 ~ 1.52), and 
thus with a lower energy efficiency. 


Is THE NE EFFICIENT? 

A natural question that arises regards the actual efficiency, or, the performance, if you wish, of the NE. 
To address this question, we first need to agree upon our performance metric. In GT, a convenient way to 
assess how desirable a solution is involves the concept of efficiency, evaluated in terms of Pareto optimality. 
A profile s is Pareto-optimal (PO) if there exists no other s such that i) Uk{^) > Uk{s) for all fc E /C, and 
ii) Uk{s) > Uk{s) for some A; E /C. In our continuous IC game, the performance achieved by the PO profile 
set is represented by the contour of the shaded area of Pig. 4, which is called the Pareto frontier. Clearly, if 
we increase ui{s) (i.e., if we move rightward along x), then 1 ^ 2 (s) decreases, and the same happens if we 
increase U 2 {s) (by moving upward along y). Still, Pareto optimality does not qualify as our performance 
metric. 

We have to further introduce the notion of social welfare (SW), that is often used as a convenient measure 
for the efficiency of a strategy vector [7, Ch. 2]. Pormally, the social-optimal (SO) profile s is the PO profile 
that maximizes the SW, defined as the weighted sum-utility where the weights {wk}ke)C^ 

JfkeJC allow us to account for different classes of service: as an example, unequal weights can be 

useful to model PUs (higher Wks) and SUs (lower Wks) in a cognitive network. In our two-player game, we 
can identify s as the tangent point between the Pareto frontier and a line with slope —wi/w 2 . As an example. 
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if we consider wi = W 2 — 0.5 (i.e., if the two players have the same priority), s/cr^ = [2.20,1.55], yielding 
^uiis) = 0.278 and ^U 2 {s) = 0.446 (Fig. 4). 

We have zoomed a section of Fig. 4 (see the inset box) to show that the NE is socially inefficient, since 
its performance is distinct from (more specifically, poorer than) that achieved by s. In general, s cannot be 
achieved by distributed algorithms, rather, it is the result of a global optimization, and in our case it turns 
out to be unbalanced towards player 2 (the one with better channel conditions): this is reminiscent of the 
waterfilling policy [4], that allocates most resources to the users that can achieve higher throughputs. More 
importantly, the magnification in Fig. 4 shows that there are a multitude of profiles that provide utilities 
lying in the Pareto improvement region, in which Uk{s) > Uk{s^) for all A; G /C (shaded region in the inset). 
Consequently, the next question is: how can we improve the efficiency of the NE? In this lecture note, 
we will focus on three popular methods, namely: i) modifying the utility functions; ii) letting the players 
interact more than once; and Hi) letting the players cooperate. 

Pricing the strategies 

The simplest method to improve the efficiency of the NE while maintaining the game structure is by 
modifying the utility function. This can be done for instance by introducing some form of externality. This 
approach is in spirit close to mechanism design [1, Ch. 7]. Eor the power control games studied so far, 
one might think of charging the players for the powers they consume, by introducing a pricing factor a 
(in b/J • W“^): Uk{s) = Uk{s) — ask = tk{s)/sk — (xsk [10]. The rationale behind this approach is the 
following: if each transmitter is discouraged from being aggressive (due to power taxation), the multiple 
access interference (MAI) experienced by the other is reduced, and both SINRs at the equilibrium stay as 
close as possible to 7 ^ (provided that the AWGN power is not dominant - a condition which always 
holds in multiple-access systems). 

To evaluate the benefits of this method, we compute the NE of the modified game, using the BR 
approach (see [9]). The cyan cross marker in Eig. 4 represents the performance T^ 2 (s*)) of 

the original utility function (4) (which is the one we are actually interested in), using a = 0.12f/(j^, that 
yields s^/cr^ = [2.17,1.57]. As can be seen, the performance of is very close to the Pareto frontier, further 
favoring player 2’s performance compared to the SW. We have thus improved the efficiency of the game 
solution, while maintaining the noncooperative nature of the interplay (with all its desirable properties). 
The main drawback is that this improvement can only be achieved after a proper tuning of a (that highly 
depends on system parameters). As an exercise, one could evaluate the performance of as a function of 
a (see [9]). 



10 


Repeating the game 

The inefficiency of the NE is mainly due to the selfish behavior (in the sense of self-optimization) of 
the players. An effective method to induce cooperation - while maintaining the noncooperative nature of 
the interaction - is forcing the players to interact more than once. A typical example of this approach is a 
repeated game, in which a static game is repeated N times. For instance, assume that the two transmitters 
of Fig. la interact a number N of times, each time selecting their optimal transmit powers Sk{n), where n 
is the time index [11]. When introducing the notion of time, each strategy set Sk becomes a complete plan 
of actions, that depends on the unfolding of the game through time. 

Similarly, the utility functions must account for i) the partial utilities Uk (s(n)) = tk{s{n))/sk (n) received 
at each stage n of the game, with s(n) denoting the profile selected by the players at time re, and ii) how 
much past utilities should be weighted (i.e., decay) compared to present ones. A simple example is the 
exponential decay, where the utility at time n is weighted by the factor 6^, 0 < 6 < 1, and the total utility 
after N repetitions of the game is (s) = J2n=o By letting W ^ oo, we further define a 

normalized utility i/^(s) = (1 — 5) XlnS) [1 !]• The parameter 6 is the so-called discount factor, 

and its meaning is borrowed from micro-economics: a payoff received at the present time n is larger by a 
factor 1/5 than the payoff of the next stage, and smaller by a factor 5 than that of the previous one. This 
means that, if players are patient (in the SP and communications context, delay-tolerant), 5 is typically close 
to 1. Conversely, if players are impatient (i.e., delay-sensitive), 5 is typically close to 0. 

Extending the concept of NE to repeated games [1, Ch. 5], we can show that the optimal strategy = 
{s^(n)}/^^ is for both players to select 5^(n) = Sk if (^^(n — 1) = Sk and s^j^{n — 1) = s\k)^ 
5^(n) = s'l otherwise, with 5^(0) = Sk, and s and being the SO and NE points, respectively, provided 
that 5 > 5 (i.e., if they are delay-tolerant enough), where 5 is a function of the network parameters [11]. In 
other words, in the repeated IC game, cooperation is enforced by letting the players interact an indefinite 
number of times: this is successful due to threatening future punishments for the player(s) who defect. 

The effectiveness of this approach is apparent in Fig. 4, where the performance of s^, represented by 
the black asterisk, coincides with the SW, under the assumption 5 > 5. As a drawback, players must have 
knowledge of s: this only occurs if each player k knows all channel gains {hjk}j^keK^ which might not be 
viable for all scenarios (e.g., in a cognitive network). Repeated games are a subclass of dynamic games, that 
are often used in SP problems to account for time evolution (see [7, Ch. 3] for more details). 
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Introducing cooperation among the players 

In the techniques considered so far, we have focused on improving the efficiency of the solution, without 
considering any fairness issue. In the example above, the SW is obtained by favoring player 2 to the 
detriment of player I’s performance, as is apparent in the inset of Fig. 4, where the SW is far away from the 
projection of the NE over the Pareto frontier - obtained intersecting it with the “fair” line with slope 1 and 
passing through (i^i(s^), We can balance efficiency and fairness by explicitly introducing cooper¬ 

ation among the players, assuming some explicit exchange of information. The fundamental difference of 
a cooperative approach is that, while in the games assumed so far cooperation can only be induced as the 
result of matching it with self-optimization (i.e., unilateral deviations are not beneficial anyway), now the 
players are willing to cooperate, as they know that they can mutually benefit from reaching an agreement. 
In GT parlance, this is called a bargaining problem [2, Ch. 7], whose analytical tools are tightly related to 
SP techniques, such as consensus algorithms [12]. 

Consider again the continuous IC game, and assume that the players can collaborate to select a satisfac¬ 
tory profile s G 5i x 52. In case they fail to reach an agreement, each player k gets Uk (s^), where is the NE 
of the noncooperative game studied before. On the contrary, the players now strive to attain the Nash bar¬ 
gaining solution (NBS), i.e., the (unique) PO profile that satisfies s = arg maxg^s 11^=1 
where the subset 5 C 5i x 52 is such that Uk{s) > Uk{s'^) for all A; G /C and s G 5 . Interestingly, the NBS 
has close analogies with proportional fair allocation mechanisms, as discussed in [2, Ch. 7]. As is apparent, 
the NBS tries to increase as much as possible the utilities of the players with respect to the NE in a fair 
manner. 

The graphical interpretation of the NBS is shown in Eig. 4: the NBS s corresponds to the profile such 
that (ixi(s), iX 2 (s)) is the point of tangency between the Pareto frontier and the hyperbola with vertex in 
X = ui{s'^) and y = U 2 {s'^). Hence, the point of tangency lies by definition in the Pareto improvement 
region, as illustrated in Pig. 4 using a blue dot. In our usual network configuration, s/cr^ = [2.26,1.52], 
yielding^i^i(s) = 0.288 and ^ 1 ^ 2 (s) = 0.434. The performance of s lies in between the SW and the 
maximum-fairness projection of the NE performance, thus trading off efficiency and fairness. The reason 
why the NBS is unbalanced towards player 2 lies again in its better channel condition, which makes it 
stronger in negotiation [2, Ch. 7]. 

Por more than two players, we can also consider a more general cooperative framework, namely coali- 
tional GT [13], that provides the theoretical tools to investigate situations in which subsets of players can 
bind agreements to work together, aiming at improving their joint utility. This approach is particularly useful 
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in many areas of SP, such as spectrum sensing for cognitive systems (see [2, Ch. 13] for further details). 

Concluding remarks 

In this lecture note, we introduced the very basic notions of GT, using a power control problem for a 
wireless interference channel as the leitmotiv: by further detailing and adding features to this “toy exam¬ 
ple,” we presented, among the others, the concepts of players, strategies, utilities, NE, Pareto and social 
optimality. The interested readers that want to deepen their knowledge of GT are invited to target specific 
textbooks, such as general ones (e.g., [1]), and those specifically tailored to an SP audience (e.g., [2], [7]). 

Reproducible research 

This lecture note has supplementary, downloadable material available in [9], provided by the authors. 
The material includes Matlab code that can reproduce all the simulation results. 
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